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SANTRAUKA 

Straipsnyje pateikiamas muzikos mokytojo rengimo progra- 
mos Granados universitete jvertinimas. Pirmoje dalyje apta- 
riamos europine, nacionaline ir universitetine jvertinimo sis- 
temos, kuriij pagrindu buvo atliktas jvertinimas. jvertinimo 
procesas apima keturiq etapq duomenq rinkimo, interpreta- 
cijLj kelimo, isorinio jvertinimo ir galutines ataskaitos rengi- 
mas atitinka svarbiausius sios jvertinimo sistemos rezulta- 
tus. 

Antroje dalyje aptariami svarbiausi surinkti duomenys, siulo- 
mos jq interpretacijos ir rekomendacijos jvairiems universite- 
to padaliniams bei bendruomenems siekiant pagerinti studi- 
jp programos kokybq. Trys jvertinimui pateiktos sritys - tai 
destymas, tyrimai bei jranga ir teikiamos paslaugos. 
Paskutineje dalyje pristatomi asmenine patirtimi paremti ap- 
mqstymai apie kokybq ir dalyvavimq jvertinimo procese. Tiks- 
las, kurio siekta jvertinimu buvo labiau orientuotas j rezulta- 
tyvumq (efficiency), nei j kokybg. Nors studentp, akademi- 
nio personalo ir kitp darbuotojp dalyvavimas jvertinime ne- 
buvo aktyvus, galima daryti isvadq, kad jis paskatino juos 
jsitraukti j bendrq veiklq. 

PAGRINDINiy SAVOKy APIBREZIMAI 

• Rezuitatyvumas - produktai ir rezultatai, kuriuos dazniau- 
siai galima ismatuoti ir kurie siekiami ir pasiekiami apgalvotai 
bet kokiomis priemonemis. 

• Kokybe - kolektyvine ir asmenine kokybe isplaukia is kom- 
forto, is pasitenkinimo, is laimes. Kokybe susiformuoja ne kaip 
kokio nors objekto savybes, bet is santykio su tuo objektu. 
Kad ir koks sudetingas butp kokybes charakterizavimas, jos 
esme gludi patirtyje (R. Stake, 2001). 

• Dalyvavimas- dalijimasis veikla ar veikimas kartu su kitais, 
identifikuojant save su kolegomis - grupes ar bendruome- 
nes nariais. 

• Objektyvus- priesingas subjektyviam, bet kokia problema, 
isskirta is bendro konteksto ir tiketina esanti neutrali ir uni- 
versal 


ABSTRACT 

This paper reports the evaluation carried out on the Music 
Teacher Education programme at the University of Granada. 
The first section deals with the European, national and 
university framework in which that evaluation was done. The 
four-stage methodology for collecting data, raising 
interpretations, external evaluation, and final report 
preparation corresponds to the main consequence of that 
framework. 

In the second part I discuss the main data collected, inter- 
pretations suggested, and recommendations raised to 
different university establishments and communities in order 
to improve the quality of this syllabus. The three purviews 
evaluated were teaching, research, and facilities and services 
provided. 

In the final section I present my reflections about quality and 
participation in evaluation that this experience suggests to 
me. Efficiency rather than quality is the aim pursued. Despite 
the low participation that students, faculties and staff members 
have had in this evaluation, I conclude that evaluation 
promoted actors’ involvement. 

DEFINITIONS KEY WORDS 

• Efficiency, products and results, usually measurable, 
pursued intentionally and obtained by no matter what means. 

• Quality, “collectivelly and personally, quality comes out of 
comfort, out of contentment, out of happiness. Quality emer- 
ges not as a property of some object but out of experience 
with that object. No matter how complex the characterisa- 
tion of quality, its origins are rooted in experience.” (Stake, 
2001 ). 

• Participation-, the act of sharing or acting with others when 
there is identification with other peer-members which 
conforms a group or community. 

• Objective', (as opposed to subjective) any issue when it is 
considered independently of its context, thus believed as 
neutral and universal. 
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jVADAS 

Siuo metu jvertinimas tampa aktualia problema Europos 
Sqjungos valstybiniuose universitetuose. Maastrichto su- 
tarties, numatancios sienq tarp saliu panaikinimq jvairiais 
aspektais, jgyvendinimas ir privaciq universitetq skaiciaus 
augimas skatina jvertinimo procedurq jgyvendinimq. Sia- 
me straipsnyje aptarsiu sias jtakas muzikos mokytojo ren- 
gimo programos jvertinimo procesui. Sj programos iverti- 
nimq inicijavo Ispanijos universitetq taryba bei pats Grana- 
dos universitetas. Aptarsiu kai kurias jvertinimo proceso 
charakteristikas, pagrindinius surinktus tyrimq duomenis, 
pasiulymus studijq programq kokybei gerinti ir pateiksime 
savo refleksijas apie jvertinimo kokybg ir dalyvavimq jverti- 
nimo procese. 

jvertinimo procesas bus aptartas pasitelkiant naujus 
aukstojo mokslo jvertinimo zemynineje Europoje standar- 
ds ir iskeliant dvi kritines siuolaikinio institucinio jvertinimo 
problemas: (1) skatinimas dalyvauti bei dalyviq pasipriesi- 
nimas ir (2) oficialiai palaikoma kokybes sqvoka, kur labiau 
akcentuojamas rezultatyvumas, o ne kokybe. Granados uni- 
versiteto muzikos mokytojo rengimo programos jvertinimo 
aprasymas bus panaudotas kaip kulturinis kontekstas ban- 
dant isnagrineti skirtingq dalyvavimo bei kokybes prasmiq, 
kurias jzvelgia dalyviai ir suinteresuoti asmenys, pries- 
taravimus. 
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OFICIALUS METMENYS 
IR METODIKA 

Aukstojo mokslo jvertinimas Ispanijoje yra aktualus klausi- 
mas, darantis jtakq keturiq lygmenq institucijoms: Europi- 
nio, nacionalinio, regioninio ir universitetinio. Universitetq 
taryba - nacionaline institucija, kuriq sudaro visq Ispanijos 
universitetq rektoriai, - pademonstravo pirmqstas pastan- 
gas 1992 m. 1995 m. buvo vykdomas europinis zvalgoma- 
sis tyrimas siekiant jvertinti aukstojo mokslo kokybg. Tyri- 
mas „pademonstravo informacijos pasidaiijimo ir pat i dies 
p/etotes svarbq kokybes uztikrinimo procese" , 2 Tais paciais 
metais buvo parengtas pirmasis planas kokybei Ispanijos 
universitetuose skatinti (Ministerio de educacion y ciencia, 
1995). Tai buvo penkeriq metq programa, kuria buvo sie- 
kiama trijLj tiksiq: sukudi universitetij kokybes kuiturq, isteigti 
kokybes uztikrinimo agenturas daugeiyje universitetij irjgy- 
vendinti agenturq veikia padedant kai kuriu regionu vaidziai. 3 

1998 m. si penkeriq metq programa buvo integruota j 
naujq iniciatyvq, kuriq pasiule Europos kokybes uztikrini- 
mo tinklas (ENQA), siekdamas skatinti aukstojo mokslo jver- 
tinimq. Sio tinklo tikslas „sk/eisti informacija, patirti, gerqjq 
praktikq ir pietoti kokybes vedinimq bei kokybes uztikrini- 
ma aukstojo moksio sistemoje tarp suinteresuotu saiig: vi- 
suomeniniu organizacijLj, vaidzios istaigu, aukstojo moks- 
lo institucijij ir kokybes uztikrinimo agenturd' . 4 Siai idejai 
impulse suteike Europos Tarybos rekomendacijos del ben- 
dradarbiavimo tarp aukstujq mokyklq kokybes uztikrinimo 
srityje 5 ir Bolonijos deklaracija. 6 Penktasis siq rekomenda- 
cijq teiginys ragina tobulinti bendradarbiavim^ Europoje, 
apibrezti kriterijus ir metodus, leidziancius atlikti aukstojo 
mokslo jvertinimo jvairiose Europos salyse palygynim^ ir 
tuo remiantis uztikrinti aukstojo mokslo kokybg. Antrasis 


INTRODUCTION 

Evaluation in European Union public universities is be- 
coming an emerging issue in these days. The imple- 
mentation of Maastrich Treatment - which implies the 
eradication of borders among countries in many as- 
pects - and the increase in private universities evoke 
the implementation of evaluative procedures. In this pa- 
per I will discuss these influences on evaluation of the 
Music Teacher Education Syllabus at the University of 
Granada. This evaluation is promoted by the Council 
of Universities of Spain, as well as by the University of 
Granada itself. I will discuss some characteristics of 
the evaluative process, the main data collected, sug- 
gestions that have been raised in order to improve the 
quality of this syllabus, and my reflections about qual- 
ity and participation in evaluation. 

My discussion of this evaluation process will be con- 
cerned both with an illustration of the new standards in 
the evaluation of higher education in continental Eu- 
rope, and with the discussion of two critical issues in 
contemporary institutional evaluation: (1) the promo- 
tion of participation and participant resistances, and 
(2) the concept of quality officially supported, focused 
more on efficiency than on quality. I will use the de- 
scription of this music education programme evalua- 
tion at Granada as cultural context in order to work 
through the contradictions in the different meanings of 
participation and of quality that participants and 
stakeholders beheld. 
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OFFICIAL FRAMEWORK AND 
METHODOLOGY EMPLOYED 

Evaluation in higher education in Spain is a recent is- 
sue affecting four different institutional levels: European, 
national, regional, and university. The Council of Uni- 
versities, a national agency composed of the rectors 
of every Spanish university, carried out the first efforts 
in 1992. In 1995, there was an European pilot project 
for evaluating quality in higher education “which dem- 
onstrated the value of sharing and developing expe- 
rience in the area of quality assurance "/Also promoted 
that year was the First Plan for Quality at the Universi- 
ties in Spain (MINISTERIO DE EDUCACION Y CIENCIA, 

1 995) . It was a five-year program that set the three fol- 
lowing objectives: the establishment of a quality cul- 
ture at universities; the creation of quality agencies in 
most of those universities; and the implementation of 
agencies by some regional governments. 3 

In 1 998, this five-year program was integrated into a 
new initiative promoted by the European Union to en- 
courage evaluation in higher education, the European 
Network for Quality Assurance (ENQA). The purpose of 
this network is to “disseminate information, experiences, 
good practices and new developments in the field of 
quality assessment and quality assurance in higher edu- 
cation between interested parties: public authorities, 
higher education institutions and quality assurance agen- 
cies”. 4 The idea was given momentum by the Recom- 
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ispaniskasis kokybes planas universitetuose buvo prade- 
tas jgyvendinti 2001 m. ir baigsis 2006 m. (Ministerio de 
educacion, cuitura y deporte, 2001 ) . 

Siame straipsnyje aptariama, kaip sie metmenys ir nu- 
rodymai buvo jgyvendinti vienu konkreciu atveju - muzi- 
kos mokytojq rengimo Granados universitete programoje. 
Straipsnyje siekiamasiqtikslq: (1) iliustruoti jvertinimo prin- 
ciple jgyvendinimo sekmes ir nesekmes; (2) pristatyti aktu- 
alias svietimo temas, susijusias su jvertinimu, ypac apie da- 
lyvavimq jvertinime ir jvertinimo kokybq; ir (3) pateikti svar- 
biausiq informacijq apie studijas Granados universitete tarp- 
tautinei auditorijai. Siq triju tikslu bus siekiama interpretavi- 
mo budu - t.y. diskutuojant, kaip naujieji europiniai stan- 
dartai buvo jgyvendinami aukstosios mokyklos muzikos mo- 
kytojo rengimo programoje. 

jvertinimo procesas vyko nuo 2000 m. spalio men. iki 
2002 m. kovo men., remiantis universitetq tarybos pareng- 
tu vadovu (Consejo de universidades, 1999). Visi anksciau 
isdestyti nurodymai siame straipsnyje pateikiami pragma- 
tiskai. Tai reiskia, kad toks pat metodas buvo taikomas vi- 
suose Ispanijos universitetuose ir panasus metodas ENQA 
priklausanciq Europos saliq universitetuose. 

Vertinimo metodika apima keturis etapus. Pirma, suku- 
riama vidine jvertinimo komisija, kuriq sudaro studentai, 
akademinis ir kitas personalas. Fakulteto administracine tary- 
ba paskiria universiteto personalo atstovus j komitetq. Visq 
katedrq, dalyvaujanciu jvertinime, susitarimu isrenkamas 
prezidentas. Studentai isrenka savo atstovus. Musq atveju 
buvo isrinkti keturi fakulteto destytojai, trys bakalauro studi- 
jq studentai irvienas administracijos atstovas. Man, kaip Mu- 
zikinio lavinimo katedros nariui, buvo patiketas komiteto pre- 
zidento vaidmenj. 

Pirmame etape komisijos uzdavinys buvo surinkti kie- 
kybinius ir kokybinius duomenis. Mes tai atlikome pasitel- 
kqdu saltinius: duomenis is centrines administracijos -pvz., 
studentq, islaikiusiq kiekvienqdalykq, skaiciq, studentu, uz- 
siregistravusiu j kiekvienq pasirenkamq dalykq, skaiciq ir 
t.t. Katedrose buvo gauti duomenys apie apgintq disertaci- 
jq ir isspausdintq moksliniu darbu skaiciq; anketos buvo 
issiqstos per 2000/2001 mokslo metq rudens ir pavasario 
semestrus. Musq studentai dalyvavo trijose apklausose: (1) 
apie paslaugas ir jrangq; (2) apie destymq; (3) trecio kurso 
studentai atsake j klausimus apie praktikq pradinese mo- 
kyklose ir atitinkamuose seminaruose, skirtuose profesiniam 
tobulejimui. Pastarqjqanketqsudare vidinis komitetas. Rek- 
torato tarnyba, atsakinga uz jvertinimq, pateike kitas pana- 
sias formas visam universitetui. Statistikos darbuotojai, dir- 
busieji toje jvertinimo institucijoje, atliko statistinq analizq. 
Kiekvienoje formoje buvo prasoma pateikti kokius nors duo- 
menis apie respondent^: lytj, gimimo vietq ir 1. 1. Po to stu- 
dentai turejo jvertinti kiekvienq teiginj skaleje nuo 1 iki 10. 
Pries teiginius budavo parasyta taisykle: /vertinkite siuos 
aspektus nuo 1 iki 10. Teiginiu pavyzdziai: „Jusu darbo truk- 
me per savaitq studijuojant sj daiykq; jusu iukesciai pries 
prasidedant Siam kursui”, ir t. t. Siu formq pavyzdziai pa- 
teikti prieduose. Skales vidurinis taskas (5,5 balai) buvo lai- 
komas minimaliu priimtinu rezultatu visose apklausose. Aka- 
deminio personalo apklausai buvo parengta kita atvirq klau- 
simq anketa, todel statistine analize cia nebuvo taikoma. 
Sitaip buvo renkama informacija apie destyma, tyrimus ir 
paslaugas bei jrangq, - tris veiklos sferas,- kurios buvo jver- 
tinamos. 


mendation of the Council on European Cooperation in 
Quality Assurance in Higher Education 5 and the Bolo- 
gna Declaration. 6 The fifth point of that statement calls 
for the promotion of European collaboration in order to 
define criteria and methods for using comparisons as a 
way to guarantee quality in higher education. The Se- 
cond Spanish Plan for Quality at Universities started in 
2001 and is to last until 2006 (MINISTERIO DE 
EDUCACION, CULTURAY DEPORTE, 2001). 

This paper reports how all these frameworks and 
regulations were implemented in a particular case: the 
music teacher education program at the University of 
Granada. My purposes with this paper are: (1) to illus- 
trate achievements and failures occurring while putting 
into practice the evaluation principles; (2) to present 
evaluative topics relevant in education, especially par- 
ticipation and quality; and (3) to offer information about 
the degree at Granada potentially relevant to an inter- 
national audience. These three aims will be carried out 
in an interpretive way, that is, discussing how in this 
music teacher education program the new European 
standards in higher education were implemented. 

The evaluation process was carried out from Octo- 
ber 2000 to March 2002 following a handbook 
(CONSEJO DE UNIVERSIDADES, 1999) provided by 
the Council of Universities. This publication is a guide 
in which all regulations earlier stated are put in a prag- 
matic way. This means that the method followed is simi- 
lar at all the Spanish universities, and pretty much simi- 
lar at those European universities whose countries are 
into the ENQA. 

The methodological approach includes four stages. 
First, an internal committee of evaluation constituted 
by faculty members, students, and staff members is 
created. The Faculty Administrative Council nominates 
faculty and staff committee members. The president is 
chosen by agreement of the main department involved. 
Students choose their own representatives. In our case, 
there were four faculty members, three undergraduate 
students, and a staff representative. As a member of 
the music education department, my role was as presi- 
dent of the committee. 

In the first stage, the committee mission is to col- 
lect quantitative and qualitative data. We did it using 
two main sources: data from the central administration 
- e.g., number of students who had passed each sub- 
ject, students registered in every optional matter...-, 
and departments - like the number of dissertations 
accepted and papers published -, and questionnaires 
sent out during the 2000/2001 school-year’s fall and 
spring semesters. Our students answered three sur- 
veys: (1) about services and facilities; (2) about tea- 
ching; (3) and juniors answered a third one about their 
practices at primary schools and corresponding super- 
vision seminars. The internal committee made this last 
questionnaire. The Rector’s Office Agency in charge 
of evaluation provided the other forms, similar for the 
whole University. Statisticians working for that evalua- 
tion agency made statistical analysis as well. Each form 
requested some data about the respondent - gender, 
hometown...-. Then, students were to rate every item 
from 1 to 1 0. Questions were presented below the fol- 


Jose Luis AROSTEGUI 

IVERTINIMO PRIESTARAVIMU ATSKLEIDIMAS: MUZIKOS HOKYTOJO RENGIMO PROGRAMOS GRANADOS UNIVERSITETE ATVEJIS 
UNCOVERING CONTRADICTIONS IN EVALUATION: THE CASE OF THE MUSIC EDUCATION PROGRAMME AT THE UNIVERSITY OF GRANADA 


Antra, vidinio jvertinimo etapo metu buvo atliekamos 
duomenu, surinktu pirmame etape, interpretacijos ir priima- 
mi sprendimai. Remdamasi uzkoduotais duomenimis, ko- 
misijos nariq stebejimais ir dalyviq nuomone, vidine komi- 
sija parase pirmqjq ataskaitq. Komitetas buvo skatinamas 
nurodyti stipriausius ir silpniausius tiriamujq sriciq - desty- 
mo, tyrimu, paslaugq ir jrangos - aspektus. Granados uni- 
versitetui mes taip pat pateikeme pasiulymus, kaip gerinti 
esamq destymo, tyrimiq ir jrangos buklp. Kadangi Universi- 
tetu tarybos vadove labai akcentuojamas aktyvus dalyviq 
jsitraukimas j vertinimo veiklq, buvo papildomai organizuo- 
tas atviras susirinkimas, kuriame viesai aptarti surinkti duo- 
menys, atliktos interpretacijos ir siulomos rekomendacijos. 
Norejome sulaukti grjztamojo rysio, kad galetume modifi- 
kuoti interpretacijas ir jas papildyti naujais siulymais. Dau- 
guma susirinkimo metu issakytq komentaru buvo jtraukti j 
galutinj pirmines ataskaitos variant^. Susirinkimas jvyko ir 
pirmine ataskaita buvo parasyta 2001 m. birzelio menesj. 

Treciame etape buvo atliktas isorinis jvertinimas. Isori- 
nio vertinimo komisija, j kuriq buvo jtraukti profesoriai is 
kitq Ispanijos universitetq, apsilanke kolegijoje ar fakultete, 
kuriq programos buvo pateiktos jvertiniti. Komisija isanali- 
zavo pirming ataskaitq, lanke patalpas, kuriose organizuo- 
jamos studijos ir jvertino isteklius. Komisijos nariai susitiko 
su visais vertinamojo sektoriaus nariais: katedrq vadovais, 
akademinio personalo nariais, kitais darbuotojais, studen- 
tais ir absolventais. Toks visq suinteresuotq pusiq dalyvavi- 
mas numatytas Universitetu tarybos i/aotoi/eesanciuose rei- 
kalavimuose. Praejus kelioms savaitems po vizito, komisi- 
ja atsiunte vizito rezultatu ataskaitq, kurioje isreista nuomo- 
ne apie pirmines ataskaitos teisingumq. 

Aptariamu atveju isorine vertintojq komisija, susidedanti 
is keturiu profesoriq, lankesi Granados universiteto Eduko- 
logijos fakultete 2002 m. sausio menesj, siekdama jvertinti 
dvi - uzsienio kalbos ir muzikos mokytojq rengimo progra- 
mas. Komisija pateike bendrq ataskaitq apimanciq abiejq 
programq vertinimq. Muzikos mokytojq rengimo programos 
jvertinimas neatitiko vidines komisijos jvertinimo tik pagal 
tris punktus. Kritikos smaigalys buvo nukreiptas j statisti- 
niq duomenu patikimumq. Isorine komisija teige, kad jver- 
tinimas nevisai pagrjstas ( valid) , nes isanalizuotas per ma- 
zas anketq skaicius - 78. Tik toks skaicius respondentq 
apklausoje atsake j klausimus apie jrangq, nes tuo metu, 
kai vyko apklausa, trecio kurso studentai atliko praktikq mo- 
kyklose. Nepaisantto, manytume, kad duomenys pagrjsti, 
nes savo nuomong pareiske pirmakursiai ir antrakursiai. 
Destymo vertinimo apklausoje, atliktoje rudens ir pavasa- 
rio semestrq metu, surinkta atitinkamai 650 ir 785 anketos. 
Studentai turejo uzpildyti po vienq anketq apie kiekvienq 
dalykq, j kurj jie buvo uzsiregistravg. Atliekant praktikumu 
jvertinimg, is 126 studentq grupes gauti 75 respondentq 
atsakymai. Be to, rezultatai atitiko duomenis, gautus is ad- 
ministracijos apklausos, ir komentarus, issakytus atvirq su- 
sirinkimq metu. Pabaigoje Rektoriaus jvertinimo instituci- 
jos darbuotojai atliko statisting analizg, atsizvelgdami j kiek- 
vienos imties charakteristikas. Mes, vidines jvertinimo ko- 
misijos nariai, manome, kad visi duomenys patikimi ir 
pagrjsti. Isimtj gali sudaryti nebent tik jrangos jvertinimo ap- 
klausos duomenys. 

Ketvirtame etape vidine vertinimo komisija turejo para- 
syti galuting ataskait^. Ji buvo rasoma remiantis ankstes- 
nemis dviem ataskaitomis iskeliant stipriausias ir silpniau- 


lowing rule: Rate from 1 to 10 the following aspects. 
Items samples are: “your weekly work for this subject; 
your expectations before you started this course ”, and 
so on. Those forms are shown in annexes. In all sur- 
veys we regarded 5.5, the middle point on that scale, 
the minimum rate to be considered acceptable. There 
was another questionnaire for faculty members. This 
questionnaire had open questions, so statistical analy- 
sis was not applied. This is how we got information 
about teaching, research, and services and facilities, 
the three ambits to be evaluated. 

Second, the internal evaluation phase deals with 
interpretations and judgements based on the data col- 
lected in the previous stage. Using coded data, com- 
mittee members observations and participants’ opin- 
ions, the internal committee writes a first report. Com- 
mittees are encouraged to point out the strongest and 
weakest features of services and facilities, research, 
and teaching. At Granada, we also raised proposals to 
improve current instruction, research, and facilities. As 
participants’ involvement is the most emphasized point 
in the handbook to counselling committees, we organ- 
ized, in addition, an open meeting to discuss publicly 
the data collected, interpretations raised, and recom- 
mendations suggested. We wanted feedback, modi- 
fying and adding new interpretations and proposals. 
Most of the comments were included in the final ver- 
sion of that early report. This meeting and this early 
report occurred in June 2001. 

The third stage concerns external evaluation. An ex- 
ternal commission with professors from other Spanish 
universities visits the faculty or college having the pro- 
gramme to be evaluated. This committee analyses the 
earlier report. Its work consists mainly of visiting facilities 
and resources. The members hold open meetings with 
every sector involved in the degree: heads of department, 
faculty members, staff, students, and alumni too. Partici- 
pation is a requirement in this phase too, according to 
the Council of Universities’ guidelines. A few weeks after 
their visit, the committee sends a report of findings in- 
cluding their opinion of the veracity of the early report. 

In our case, a four-professor external committee vi- 
sited the Granada faculty of education in January 2002 to 
evaluate two teacher education programmes: foreign lan- 
guage and music education. They submitted a joint re- 
port covering both degrees. With regard to the music 
education programme evaluation, there was agreement 
with the internal committee except on three points. The 
most important had to do with the validity of the statistical 
data. The externals perceived the validity weak based on 
the low number of questionnaires, 78. This number was 
correct for the services surveys, because juniors were in 
the practice phase at schools when we sent out the ques- 
tionnaires. Despite that, we still considered the data to be 
valid, having freshmen and sophomore students in mind. 
With regard to teaching surveys, we collected 650 and 
785 questionnaires in the fall and spring semesters, re- 
spectively. Students had to fill one form per subject en- 
rolled. With the practicum survey we got 75 responses 
from a group of 126. In addition, results were consistent 
with those obtained from administration data and com- 
ments raised in open meetings. Finally, professionals from 
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sias puses ir pateikiant programos patobulinimo pasiuly- 
mus. Baigus jvertinimo process, atejo laikas parengti pro- 
gramos tobulinimo planq ir imtis jgyvendinti Rektorato pri- 
imtus pasiulymus. Ataskaitoje pateiktos rekomendacijos ne- 
ra jpareigojancios, todel j jas galima atsizvelgti arba ne. 
Granados universiteto galutine ataskaita buvo baigta 2002 
m. kovo menesj, o isspausdinta rugsejo men. (Arostegui, 
J.L. et. al., 2002/ Siuo metu Granados universitetas rengia 
tobulinimo planq. 

2 

MUZIKINIO RENGIMO 
ATASKAITOS SANTRAUKA 

2000-2001 mokslo metais studijuoti pagal trejij metq mu- 
zikos mokytojo rengimo program^ buvo priimta 412 stu- 
dentq. PriimtLj pirmo kurso studentq skaicius kasmet su- 
mazedavo nuo 100 iki 90 antrajame kurse. Galbut kitose 
salyse tai butij didelis skaicius, taciau Ispanijoje taip ne- 
manoma. Kiekviena grupe muzikos dalykij paskaitq metu 
ir kai kuriu kitq dalykq praktiniq darbq metu dalijama j dvi 
dalis. Per kai kuriuos praktinius dalykus, sudarancius apie 
50% visos programos kreditu, sie du pogrupiai dalijami per 
pusg j dar mazesnius pogrupius. Tai reiskia, kad analizuo- 
jant tokias temas kaip muzikos kompiuterines programos, 
vokalinis ar instrumentinis atlikimas studentq skaicius gru- 
pese yra nedidelis - mazdaug 30 studentq. 7 

Studentu pasiskirstymas pagal lytj: 48 proc. sudaro vai- 
kinai, 52 proc. merginos. Toks pasiskirstymas skiriasi nuo 
kitq mokytojq rengimo programq musu fakultete, kur mo- 
terys sudaro didziqjq daugumq, isskyrus kuno kulturos ren- 
gimo program^, pagal kuriq studijuoja daugiau vyrq. Jei 
laikytumemes feministinio ir kritinio mqstymo, pvz., Apple 
(1995) - kad mokytojo darbas yra profesija, kuriai lemta 
buti feministine, musq respondentq pasiskirstymq pagal lytj 
turejo lemti muzikinio, o ne pedagoginio \ss\\aM\n\mo pasi- 
rinkimas. 

Neislaikiusiq egzaminq studentq skaicius buvo gana 
aukstas. 72 proc. aukstesniq nei pirmo kurso studentq ga- 
vo skolas is dalykq, kuriuos studijavo tyrimo metu. Sis skai- 
cius sutampa su neislaikiusiqju kokio nors studiju dalyko 
studentq skaiciumi kitose mGsu universiteto mokytojq ren- 
gimo programose. Analize pagal lytj ir kursq rodo, kad nor- 
mali proporcija tarp visq antro kurso merging ir vaikinq, ne- 
islaikiusiqjq paskutinio dalyko yra 2 ir 3 (1 lentele). 


1 lentele. Merging ir vaikinq neislaikytu studijq dalykq skaicius 
antrame ir treciame kursuose 


NEISLAIKYTI DALYKAI 

ANTRAKURSIAI 

TRECIAKURSIAI 

Vaikinai 

65% 

87% 

Merginos 

67% 

68% 


Analizuojant dabartinio treciojo kurso ir ankstyvesnius 
studentq, kurie nebaige studijq, duomenis, matome, kad 
egzaminq neislaikiusiq vaikinq procentas gana aukstas - 
neislaike 87 proc. visq vaikinq treciakursiq. Cia galimos dvi 
duomenq interpretacijos: (1) merginos sugeba geriau pri- 
sitaikyti prie destytojq ir destymo sistemos; (2) kai kurie 
destytojai nemegsta studentq vaikinq. Analizuojant bendr^ 


the Rector’s evaluation agency made a statistical analy- 
sis, having in mind the characteristics of each sample. 
With the possible exception of the services questionnaires, 
we internals regarded all data as reliable and valid. 

Finally, in the fourth stage, the internal committee 
has to write the final report. It draws from the two pre- 
vious reports, stressing strongest and weakest points, 
as well as suggestions to improve the programme. 
Once the evaluation process has finished, it is time to 
prepare an improvement plan to put into practice those 
suggestions accepted by the Rector's Office. Recom- 
mendations included in the report are not prescriptive, 
and may be followed or not. At the University of Gra- 
nada, the final report was finished in March 2002, and 
published in September (AROSTEGUI, J.L. ET AL, 
2002) Granada University is currently developing the 
improvement plan. 


2 

A SUMMARY OF THE MUSIC 
EDUCATION REPORT 

The number of students enrolled in the three-year mu- 
sic teacher education degree was 41 2 during the 2000/ 
2001 school-year. The quantity of freshmen admitted 
annually was reduced from 100 to 90 the following 
course. These numbers would be huge for many coun- 
tries, but they are not very high in Spain. In the music 
teacher education case, each group is divided in two 
for music subjects. For some subjects groups are di- 
vided again in two for practical classes, which are around 
50% of the credits of this programme. This means wor- 
king with around 30 students in topics like music soft- 
ware and vocal or instrumental performances 7 . 

Distribution of students by gender is: 48% men and 
52% women. This contrasts with other teacher educa- 
tion degrees in our Faculty, where women are the over- 
whelming majority, except in the physical education de- 
gree, where there are many more men. If we agree with 
feminist and critical thinking - e.g. , APPLE (1 995) - that 
teaching at schools is a profession deemed feminine, 
our gender distribution is due to music rather than edu- 
cation having the bigger influence in students’ selec- 
tion of this degree. 

The number of students failing subjects was high. 
Of non-freshmen students 72% had failed to get credit 
in their most recent course. This number is in accor- 
dance with the ratio of students who failed some sub- 
ject in other teacher education degrees at our univer- 
sity. If we analyse these data by gender and course, 
we find the normal ratio of students who did not pass 
last courses completely was around 2/3 for all female 
students and male sophomores too (Table 1). 


Table 1. Number of subjects failed refering to 
sophomores and juniors of male/female gender 


SUBJECTS FAILED 

SOPHOMORES 

JUNIORS 

Male 

65% 

87% 

Female 

67% 

68% 
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studentq, kurie neislaike studijuojamo dalyko is pirmo kar- 
to, skaiciq matome, kad jis labai aukstas. 

Kita vertus, pasirenkamq studijq dalykq neislaikiusiq stu- 
dentq skaicius nedidelis. Neislaikq kokio nors studijq daly- 
ko egzamino, kitais metais studentai registravosi jau j kitq 
pasirenkamq dalykq. Is pirmo karto pasirenkamuosius da- 
lykus islaike 88 proc. studentq, o privalomus dalykus tik 75 
proc. Jei palyginsime siuos duomenis su studentq, kurie 
yra bandq laikyti tq pirmqjj egzaminq procentu, pamatysi- 
me, kad pagal atskirus dalykus rezultatai labai skiriasi. Bu- 
vo isnalizuotas santykis tarp laikiusiq ir egzaminq islaikiu- 
siq studentq skaiciaus, nes pastebeta, jog daugelis studen- 
tq, stengdamiesi isvengti skolos, patys nejo laikyti kai kuriq 
dalykq egzaminq. Zemiausi rezulatai islaikiusiqju sj egza- 
minq is pirmo karto buvo per „Klausos irbalso treniravimo" 
dalyko egzaminq, kurj islaike tik 18 proc. visq uzsiregistra- 
vusiq studentq. Geriausi rezultatai pasiekti Praktikumo Hr II 
egzaminq metu - islaike 98 proc. studentq. Labiausiai issi- 
skiriantys dalykai, issidestantys skales pradzioje arba ga- 
le, parodyti 2 lenteleje. 


2 lentele. Studentq skaicius is pirmo karto islaikiusiq egzaminq 


STUDIjy DALYKAI 

PROC. 

Klausos ir balso treniravimas 

18 

Pedagogine psichologija 

23 

Muzikos instrumentq jvaldymas 

32 

Ritminis iavinimas ir sokiai 

32 

Psichologiniai specialaus ugdymo pagrindai 

36 

Mokymo turinio teorija 

38 

Muzika spektakliui, filmui, muzikine kuryba 
ir naujos technologijos 

89 

Mokyklinis choras 

92 

Praktikumas III 

96 

Praktikumas 1 ir II 

98 


Vidinis komitetas ir ivertinimo dalyviai atvirame susirin- 
kime pateike tris galimus rezultatq paaiskinimus: 

1 . Kai kurie destytojai reikalauja per auksto akademinio 
atlikimo lygio. Atrodo, kad apklausos rezultatai tai patvirti- 
na. 

2. Studentai per mazai dirba. Tokia buvo destytoju ir net 
paciq studentq nuomone, pareiksta atviro susirinkimo metu. 

3. Pasikeite studentq kontingentas. Anksciau studijuoti 
jstodavo studentai, jau turintys muzikini issilavinimq kon- 
servatorijoje, dabar tokiq buna nedaug. Nera papildomo 
reikalavimo tureti muzikinj pasirengimq norint studijuoti pa- 
gal siq programq; taigi, negalima numatyti muzikiniq pa- 
grindq standarto perkelimui j aukstesnj kursq. 

Destymo kokybes jvertinimo anketose studentq jverti- 
nimu vidurkis buvo 6.1 skaleje nuo 1 iki 10. Sis rezultatas 
gautas susumavus atsakymus is kiekvienos anketos. 8 Ap- 
tariamo dokumento vertimas pateiktas 1 priede. 

Anketos klausimai suskirstyti j tris temines grupes: stu- 
dentai, studijq dalykas ir destytojai. Paskutines temos jver- 


Of the current junior students - and earlier ones 
who have not yet finished 87% of the total were fail- 
ing. There are two possible interpretations: (1) women 
are more adapted to the instructors teaching system; 
(2) some instructors not wanting male students. Attend- 
ing to the overall number of students who have not 
passed subjects in the first try is very high. 

The number of students who did not pass optional 
subjects, on the other hand, was very low. When fail- 
ure happened, the student enrolled in a different op- 
tional subject the next year. The percentage of students 
who passed optional subjects at first try was 88%, 
against 75% for required matters. If we join these data 
with the percentage of students who took that first exam, 
we find a too wide range of students passing for each 
subject. We attended to the rate of students who took 
the tests, in addition to those who passed, because we 
observed in some subjects a high number of students 
not taking tests voluntarily. The lowest rate of students 
overtaking a subject at first try was got in Aural and 
vocal training, with 1 8% of students enrolled. The high- 
est was attained in Practicum / & II, passed by 98% of 
them. The most outstanding subjects in each end of 
the scale are shown in the following Table 2. 


Table 2. Students who took the tests for the first time 

and passed them 


SUBJECTS 

% 

Aural and vocal training 

18 

Psychology of education 

23 

Musical instruments training 

32 

Rhythmical training and dance 

32 

Psychological bases on special education 

36 

Curriculum theory 

38 

Incidental music, musical creativity, 
and new technologies 

89 

School choir 

92 

Practicum III 

96 

Practicum 1 & II 

98 


The internal committee and participants in the open 
meeting raised three possible reasons for these data: 

(1) Some instructors demand too high a level of 
academic performance. Survey results seem to con- 
firm it; 

(2) Students do not work enough. Instructors’ and 
even students’ perceptions stated in open meetings 
such a possibility; 

(3) Students’ profile has changed. They used to 
come with prior conservatory musical training, currently 
it is less frequent. It is not required to have musical 
knowledge to access this degree program, so we can- 
not envisage a standard musical background for the 
next promotion. 

With regard to the teaching surveys, the overall ave- 
rage rating given by students was 6.1 in a scale from 1 
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tinimo rezultatai buvo zemiausi (vidurkis - 5,6). Blogiau- 
siai jvertintas laiko, skirto individualioms konsultacijoms 
su destytojais, panaudojimas (X=2.7). 9 Atsakymai buvo 
neigiami. Tai rodo, kad studentai retai isnaudoja jiems 
skirtu konsultacijij laikq, o destytojai nerodo iniciatyvos. 
Geriausiai studentai vertina paskaitq lankymq (X=8.0). 

Taikytas ir koreliacijq metodas. Studento pasitenkini- 
mas destytojo darbu sietas su destytojo motyvacija, ais- 
kiu ir nuosekliu medziagos isdestymu ir jvairiu aiskinimo 
metodu taikymu. Koreliacijos koeficientai svyravo nuo 0.7 
iki 0.8. Kitos koreliacijos buvo daug zemesnes. 

Kadangi studentai pilde kiekvieno dalyko, i kurj jie bu- 
vo uzsiregistravg, jvertinimo formas, galejome atlikti sta- 
tistinp lyginamqjqdalykq analizp. Daugeliu atveju muzikos 
disciplines gavo geresnius jvertinimus nei bendrieji daly- 
kai. Atrodo, kad studentai geriau jvertino muzikos discipli- 
nes del vienos priezasties - jie teike pirmenybg pasirenka- 
miems dalykams, susijusiems su muzika. Jie labiau domi- 
si muzika negu jos mokymu ar kitais dalykais. Kita galima 
interpretaeija - muzikos dalykq destytojai geresni nei kiti 
fakulteto Edukologijos katedros destytojai, nors nera ob- 
jektyviij priezasciq manyti, kad kokios nors katedros des- 
tytojai bOtLj daug geresni ar daug blogesni nei kiti. 

Spejirmas, kad egzistuoja rysys tarp kiekvieno dalyko 
kokybes jvertinimo atskirose anketose ir studentq pazy- 
miij, gautu is to dalyko, nepasitvirtino. Geriausiai studentq 
jvertintq dalykq pazymiai nebutinai buvo labai geri, ir at- 
virksciai. /spang kalba ir iiteratura s\.uben\v\ buvo zemiau- 
siai jvertinta rudens semestre pagal daugelj kriteriju. O pa- 
vasario semestre Uzsienio kaibos gavo auksciausius jver- 
tinimus. Kiti dalykai taip ryskiai kaip sie du neissiskyre. 

Pasitaike atvejq, kai tas pats dalykas, kurj dviejose 
studentij grupese desto skirtingi profesoriai, buvo verti- 
namas labai skirtingai. Tai dar kartq rodo, kad destytojai 
daro didziulq jtakq studentq suvokimui. Tai taip pat pa- 
deda suprasti, kodel klausimas apie individualq konsul- 
tavimq Mokyklos vadybos disciplines kurse gavo auks- 
ciausiq jvertinimq (X=5.7) palyginti su bendru dalyko iver- 
tinimu. Sio dalyko destytojas akcentavo individualaus 
konsultavimo reiksm§. 

Pagrindine studentq praktikos problema buvo ta, kad 
jq atlikdami mokyklose tik dalis studentq jq atliko esant 
mokykloje muzikos mokytojams, nes dauguma jq tuo me- 
tu nebuvo mokykloje. Praktikos jvertinimo rezultatai buvo 
panasus j k^ tik aptartus rezultatus. Bendras vidutinis ba- 
las buvo 6.4. Individualus konsultavimas vel buvo labai ze- 
mai jvertintas, o patirties, jgytos praktikos mokykloje me- 
tu, svarba mokytojo profesijai gavo auksciausius jvertini- 
mus (X=8.3). Vienas is penkiu destytojq, vadovavusiq stu- 
dentq praktikai mokykloje, buvo jvertintas auksciausiu ba- 
lu 9.2. Kitu destytojq darbo jvertinimas svyravo nuo 6.1 iki 
6.6. Sios anketos vertimas pateiktas 2 priede. 

Kitas analizuotas klausimas buvo destytojq atliekami 
tyrimai. Pirmasis duomenq saltinis buvo profesoriq, do- 
centq, destytojq asistentq ir kito akademinio personalo 
nariu, dirbanciu muzikos mokytojo rengimo programoje, 
skaicius kiekvienoje katedroje. Pavyzdziui, ar katedroje 
desto profesorius, ar katedros nariu amziaus vidurkis gali 
rodyti aukstenj tos katedros sutelktumq. Dareme prielai- 
d^, kad tarn tikra katedros sudeties pusiausvyra gali tu- 
reti jtakos tyrimams. Antrasis naudotq duomenq saltinis 
buvo 1999-2000 m. kursq aprasas, kurj isleido universi- 


to 1 0. This score is the mean attained from the sum of all 
items across every form. 8 A translation of this document 
is provided in Annex 1 . 

Questionnaire items are grouped by three topics: stu- 
dents, subject matter, and instructors. This last section 
got the lowest score, 5.6 on average. The item worst 
scored was students’ deployment of tutoring time, with 
X=2.7. 9 The responses here were very low. This means 
the scarce usage by students do of tutoring time, and 
the lack of incentive by instructors. The items regarding 
students’ regularity attending classes got the best mark 
(X — 8.0). 

We also used correlations. The item about students’ 
satisfaction with the instructors' teaching correlated with 
instructors’ motivation, clarity and order in explanation, 
and the using of different explanation methods. Correla- 
tion coefficients were between 0.7 and 0.8. Other corre- 
lations were much lower. 

As students filled out a form for each subject enrolled, 
we were able to make a statistical comparative analysis 
among subjects. For the most part, music subjects got a 
bit higher average mark than general subjects. Students 
are likely scoring higher music subjects for the same rea- 
son whereby they preferred optional subjects related to 
music. They are more involved in music rather than in 
education or any other topic. Another possible interpre- 
tation is that music instructors are better than other fac- 
ulties at the Education Building, but there are no objec- 
tive reasons to think instructors from any department are 
particularly better or worst than others. 

When we tried to find out a possible relation between 
how the students rated the questionnaires per subject, 
and degrees attained in each subject, we could not find 
any relationship. Courses with highest degrees do not 
necessarily get the highest marks, and vice versa. Spa- 
nish language and literature got the lowest students’ score 
- fall semester- on most of the items. Foreign language 
got the highest - spring semester. No other subjects stood 
out in the same extent than those two matters. 

Sometimes, subjects with two student groups, each 
taught by a different professor, scored very differently. 
This confirms, once again, that instructors have a crucial 
influence on students’ perceptions. This also explains the 
high mark reached in the tutoring item in School mana- 
gement^^!) compared with the overall score attained. 
That instructor stressed the using of tutoring. 

The main problem with the practicum was that not 
many students could attend practice with music teachers 
while they were out at schools. The practicum survey 
scores were similar to those just discussed. The overall 
average score attained was 6.4. Tutoring again got the 
lowest, and the relevance for their professional lives of 
the experience of working at schools got the highest 
(X=8.3). One of the five instructors supervising students 
at schools got a very high average mark, 9.2. The other 
instructors scored between 6.1 and 6.6. A translated copy 
of this questionnaire is shown at Annex 2. 

The next issue enquired was research. The first source 
of data used was the number of professors, associated 
teachers, teacher assistants, and other faculty members 
in each department involved in the music teacher educa- 
tion degree. For instance, the existence of a professor in 
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tetas (Universidad de Granada, 2000). Teoriskai ziurint 
sioje knygoje turejo buti surasyta jvairi tu mokslo metLj 
veikla, bet is tikrqjq cia jtraukta ne viskas. 

Daugelis katedrq destytojq buvo daugiau kaip trisde- 
simties metq, vienu kitu atveju - daugiau kaip keturiasde- 
simties ar zemiau dvidesimties. Muzikos katedroje daugu- 
mos destytojq buvo virs dvidesimties. Daugelyje katedrq 
buvo aptiktas balansas tarp pilnq ir dalj laiko dirbanciq des- 
tytojq - tai rodo, jog katedros yra jkurtos. Kalbant apie 
moksling produkcijq reikia pasakyti, kad visose katedrose 
buvo sudarytos sqlygos jgyti daktaro laipsnj. Buvo sukur- 
ta daug tyrimu grupiu (pvz., Filologijos - astuoni nariai, 
mokymo turinio ir mokymo - penki). Daugiausia mokslo 
tiriamqjq projektq jgyvendinama Raidos psichologijos ka- 
tedroje. Siuo metu katedroje vykdoma desimt projektq, o 
juose dalyvauja visi katedros nariai. Raidos psichologijos, 
Kalbq ir literaturos bei Muzikos mokytojq rengimo kated- 
ros labai aktyviai dalyvavo konferencijose ir seminaruose, 
ir buvo jvertintos aukstais balais. Siq renginiq organizavi- 
mu issiskyre Mokymo turinio ir Mokymo katedros. Visose 
katedrose buvo parengta daug spausdintq straipsniu ir sky- 
riq knygose. Trumpai tariant, tiriamasis darbas vykdomas 
gerai, taciau jo sklaida nepakankama. 

Paskutine musq ataskaitos tema apeme paslaugu ir 
jrangos universitete vertinimq. Tyrimui buvo sudaryta an- 
keta, kurioje kausiama apie tris veiklos sferas: paslau- 
gos edukologijos pastate - valymas ir tvarkos palaiky- 
mas, kopijavimo paslaugos irt. t.; paslaugos, kurias tei- 
kia universitetas savo bendruomenei visoje universiteto 
teritorijoje-sporto paslaugos, universiteto centrines bib- 
liotekos paslaugos ir 1. 1. ir isorines universiteto paslau- 
gos (telefonai ir bankomatai, stipendijos ir kt.). Anketos 
formos struktura buvo tokia pat, kaip ir apklausos apie 
destymq anketa. Is pradziu buvo pateikti keli klausimai 
apie lytj, gyvenimo pobudj Granadoje ir pan. Po to stu- 
dentai turejo jvertinti kiekvienq paslaugq skaleje nuo 1 iki 
10. Kiekvienai paslaugai buvo skirtas atskiras punktas. 
Forma pateikta 3 priede. 

Kai kuriq punktu jvertinimai buvo zemi, pvz., apie stu- 
dentq informavimo centrq ar pastovias studijq paslaugas. 
Tai gali rodyti tai, kad studentai nesupazindinti su siq ins- 
titucijq veikla. Vidutinis siq paslaugu jvertinimo balas ska- 
leje nuo 1 iki 10, susumavus visus jvertinimus, - 5.0. 
Zemiausiu balu jvertintos registracijos proceduros 
(X=2.7). jdarbinimo agentura (X=3.2), studentu informa- 
vimo centras (X=3.2), ir studijq sqlygos Edukologijos ka- 
tedros pastate (X=3.6) taip pat buvo jvertintos prastai. 
Vidinio komiteto ir isorines vertinimo komisijos jvertini- 
mai del studijq sqlygq tinkamumo nesutapo. Isorine ko- 
misija gana gerai jvertino studijq patalpas ir jrangq. Tei- 
ravomes apie tuo paciu metu atliktus kitu studijq progra- 
mq, vykdomq Edukologijos katedros pastate, jvertinimus. 
Kuno kulturos mokytojq rengimo programos studentai 
jvertino jrangq 5.1 . Tai gana zemas jvertinimas desimties 
balu skaleje, bet jis aukstesnis nei busimq muzikos mo- 
kytojq jvertinimas. Jie jvertino savo studijq programos 
jrangq tik 3.6 balo. Galime daryti isvadq, kad toki zemq 
rezultatq leme muzikos mokytojq rengimui butinos spe- 
cifines jrangos stoka. Vidinis komitetas taip pat muzikos 
mokytojq rengimui butinus materialinius isteklius jverti- 
no gana prastai. Kavine Edukologijos katedros pastate 
buvo jvertintaauksciausiais balais (X=8.4). Kitas paslau- 


a department or the average age of department mem- 
bers might indicate a bigger consolidation of that depart- 
ment. We assumed that certain balances in the depart- 
ment compositions might aid research. The second 
source employed was the 1999/2000 annual course in- 
ventory edited by the University (UNIVERSIDAD DE GRA- 
NADA, 2000). Theoretically, this book included all activi- 
ties of that school year, but not everything was included. 

Department instructors are mostly in their forties, with 
some exceptions in their fifties, or thirties. This is the case 
of the Music Education department, where most of in- 
structors are in their thirties. We found a balance between 
full and interim instructors in most divisions. This means 
that departments are established. With regard to scien- 
tific production, all departments offered the PhD degree. 
There was also a high number of research groups (e.g., 
Philology with eight, Curriculum and Instruction five). The 
department with most research projects ongoing was De- 
velopmental Psychology. This department had ten 
projects in progress with all its members involved. Par- 
ticipation in conferences and seminars was high in De- 
velopmental Psychology, Language and Literature, and 
Music Education. Curriculum and Instruction stood out 
in the organization of those events. All departments had 
a high production of papers and in book chapters. In 
short, we perceived good research work albeit not widely 
enough circulated. 

The last issue in our report was services and facilities 
at the university. We used a questionnaire dealing with 
three different ambits: services at the education building 
- cleaning and maintenance, copier service...; campus 
wide services provided by the university for the whole 
community - sports, central library...-; and external uni- 
versity services (telephones and ATMs, grants...). The 
form was structured as the teaching survey was. After 
some questions about gender, kind of residence at Gra- 
nada, and the like, students were requested to rate each 
service from 1 to 10. Each service was an item. The form 
is provided in Annex 3. 

Response rates to some items was low, e.g., about 
the student information centre, or the permanent training 
service. This is because students did not know those fa- 
cilities. The average mark attained in the survey after all 
the scores were summed was 5.0 on a scale from 1 to 
10. The lowest score was for the registration procedure 
(X=2.7). The employment agency (X=3.2), the students’ 
information centre (X=3.2), and education building fa- 
cilities (X=3.6) also scored very low. There was disagree- 
ment between the external and internal committee with 
regard to the appositeness of facilities. The external com- 
mission deemed facilities good enough. We enquired 
about marks obtained in other programme evaluations 
carried out at the Education Building at the same time. 
Physical education students scored facilities with 5.1. It 
is still low in a scale from 1 to 10, but not so much as 
music teacher education students did, 3.6. We concluded 
that specific facilities in music education were the conse- 
quence of that score. The internal committee’s percep- 
tion of those music education resources agreed with that 
low mark. The cafeteria service at the Education building 
was the highest scored (X=8.4). Other services valued 
by students were cleaning and maintenance of the edu- 
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gas studentai jvertino taip: valymas ir tvarkos palaikymas 
Edukologijos katedros pastate (X=6.6), biblioteka (X=6.3), 
socialinis klimatas universitete (X=6.8), universiteto valgyk- 
los patalpos (X=6.9), universiteto gyvenamieji pastatai 
(X=6.4). 

Taikydami inferencialinq ( apibendrinamqjq ) statistikq pa- 
lyginome grupiq atsakymus. Rezultatai parade vienq svar- 
bu skirtumq: antrojo kurso studentai visas paslaugas jverti- 
no zemiau nei ju kolegos pirmakursiai, isskyrus kavinq, ku- 
riq antrakursiai jvertino aukstesniais balais. Manome, kad 
si isvada yra svarbi. 

Paskutineje jvertinimo ataskaitos dalyje pateikeme re- 
komendacijas visoms universiteto bendruomenems ir pa- 
daliniams, atsakingiems uz programos jgyvendinimq: 

* Rektoratui: (1) Pagerinti universiteto teikiamij paslaugq 
sklaidq. (2) Sukurti specially testq priemimui j muzikos mo- 
kytojo rengimo programos studijas, nes dabartinis panasus 
kaip ir visiems stojantiems j universitetq. (3) Sukurti sqsajas 
tarp muzikos programq konservatorijoje ir muzikos mokyto- 
jo rengimo programos universitete, kadangi studijos kon- 
servatorijoje nera universitetines studijos. Paradoksalu, bet 
konservatorijos aukstesnysis laipsnis atitinka universiteto ma- 
gistro laipsnj. 

* Dekanatams ir rektoratui: (1) Sudaryti sqlygas viesam 
dekanatq vadybos istyrirmui. (2) Pagerinti studentq regist- 
racijos proceduras 10 . (3) Turetq buti daugiau pasirenkamu 
dalykq grupiq, kad kiekvienas studentas galetu realiai rink- 
tis. (4) Pratqsti administracijos darbo laikq, kad po pietq 
studentai galetq j jq kreptis. Dabar j administracijq galima 
kreiptis nuo 9 iki 14 val., nors yra studentq, uzsiregistravu- 
siq j dieninius (nuo 8:30 iki 1 4:30) ir vakarinius kursus (nuo 
15:30 iki 21:30). (5) Pagerinti muzikinius isteklius ir jrangq 
- galutineje ataskaitoje mes pateikeme sesis specifinius pa- 
siOlymus. (6) Isplesti patalpu studijoms ir darbui grupese 
plotq bei universiteto bibliotekos plotq, nes biblioteka jau 
darosi per maza saugoti visus reikiamus saltinius. (7) To- 
liau laikytis skaidymo j grupes per muzikinio lavinimo prak- 
tikq principo. (8) Gerinti studentq praktikq mokyklose 11 . (9) 
Kai kuriuos antro kurso studentams siulomus dalykus ru- 
dens semestre perkelti j pavasario semestrq, nes akivaiz- 
du, kad rudens semestre destoma per daug dalykq. (10) 
Pagerinti muzikos mokytoju rengimo programq 12 . 

* Studentams: (1) Prisiimti daugiau atsakomybes pa- 
tterns. Kai kurie surinkti duomenys rodo, kad studentai tu- 
retq daugiau dirbti patys ir jsitraukti j universiteto vadybq 
per savo atstovus 13 . 

* Destytojams: (1) Skatinti studentq individualq konsul- 
tavimqsi su destytojais, kuris siuo metu per mazai panau- 
dojamas. (2) Labiau nei iki siol kontroliuoti studentq darbq. 
Destytojai buvo puikiai jvertinti tais atvejais, kai nereikalin- 
gas tiesioginis destytojo ir studentq rysys, pvz., destymo 
aiskumas, istekliq panaudojimas ir 1. 1. Taciau tais atvejais, 
kai reikalingas tiesioginis destytojq ir studentq kontaktas - 
akademiniai santykiai, kontrole irt. t., rezultatai buvo pras- 
ti. Anksciau paminetos koreliacijos - studentus tenkinan- 
cio darbo rysys su kitais trim klausimais - taip pat suvokia- 
mas ir siuo atveju. (3) Pagerinti kai kuriq destomq dalykq 
kokybg. Kaip rodo aptarti duomenys, kai kuriq dalykq des- 
tymas gali buti pagerintas is esmes. (4) Skatinti kritinj mqs- 
tym^ ir vengti mechaninio mokymosi atmintinai. (5) Tinka- 
mai isnaudoti praktikai skirtq laikq. Zemi vertinimai atsklei- 
dzia silpn^ praktiku jgyvendinim^. (6) Organizuoti destyto- 


cation building (X=6.6), education library (X=6.3), so- 
cial climate at the university (X=6.8), university dining 
halls (X=6.9), and university residences (X=6.4). 

We compared groups using inferential statistics. We 
found one relevant difference: sophomores scored all 
services lower than their freshmen mates, except the 
cafeteria, whose mark was higher for sophomores. We 
thought this exception important. 

The final section of the evaluation report included 
the recommendations we raised for the different com- 
munities and establishments involved in this pro- 
gramme: 

• To the Rector's Office: (1 ) To make a bigger diffu- 
sion of university services than that currently happening. 
(2) To create a specific test to gain access to the music 
teacher education degree program. Now there is a test 
similar for any student who wants entry to the univer- 
sity. (3) To establish links between musical degrees at 
the conservatory and the music teacher education de- 
gree. Studies at conservatories do not have university 
rank. Paradoxically, the conservatory superior degree 
is equivalent to a university master degree. 

• To the Dean’s and Rector's Offices: (1) To open 
the management of the Dean’s Office to public scru- 
tiny. (2) To improve registration procedures 10 . (3) More 
optional subjects groups should be created in order to 
guarantee that every student has real choices. (4) To 
open administration services in the afternoon - nowa- 
days, administration is open for the public from 9 to 2, 
whereas there are students enrolled in matinee (from 
8:30 am to 2:30 pm) and evening (from 3:30 pm to 
9:30 pm) schedules. (5) To improve musical resources 
and facilities - in the final report we included six spe- 
cific suggestions. (6) To expand rooms available for 
study and working groups, as well as for the education 
library, which is getting small for the references stored. 
(7) To go on with the policy of splitting groups for prac- 
tices in music education. (8) To improve the students’ 
practices at schools 11 . (9) To change some subjects 
that sophomores take in the fall semester to spring - 
they feel that fall semester is too loaded. (10) To im- 
prove the music education programme 12 . 

• To students: (1) To assume more of their own re- 
sponsibilities. Some data collected indicate students 
should be more involved in their own work, as well as 
the university management through representatives 13 . 

• To faculty members: (1) To promote tutoring, 
clearly underused. (2) To monitor students’ work more 
than at present. Instructors scored high on items in 
which there is no need for direct relation with students 
- clarity in explanations, resources employed...-. Low 
scores were obtained in items where that relationship 
is required - academic relations with students, moni- 
toring . . .-. Correlations earlier stated among students’ 
satisfaction with the instructors’ teaching with three 
other items go in this same sense. (3) To improve qua- 
lity in some subjects. According to data discussed, it is 
clear that some subjects can be improved substantially. 

(4) To promote more critical thinking, and less rote work. 

(5) To fulfil practical credits. Low ratings on that item is 
a clue of weak accomplishment. (6) To organize instruc- 
tors’ own work to give coherence and complementarity 
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ju darbq taip, kad tq paciu dalykq destymas butu darnes- 
nis ir papildytq vienas kitq. Duomenys rodo, kad sioje srity- 
je truksta koordinacijos. Kai kurie vidinio komiteto nariai 
mano, kad nesutarimai katedroje gali buti sios problemos 
esme. 

• Universiteto bendruomenei: (1) Skatinti dalyvavimq 
instituciniuose forumuose ir jvertinimo procesuose. Dau- 
guma studentLj nedalyvavo apklausose, nors, zinoma, jie 
buvo atstovaujami. Akademinis personalas bei kiti darbuo- 
tojai taip pat labai ribotai dalyvavo vertinime. (2) Demokra- 
tizuoti kiekvienq universiteto veiklos sriti. Cia nekalbame 
apie formalin demokratijq, kuri tikrai egzistuoja, bet apie 
faktinq demokratijq, kur kiekviena bendruomene jauciasi 
esanti platesnes universiteto bendruomenes dalis priklau- 
somai nuo to, kiek dalyvauja institucijos veikloje. 

Ataskaitos pabaigoje pateikiamas siq rekomendacijq 
jgyvendinimo grafikas ir numatomi tolimesnes veiklos pri- 
oritetai. 
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KOKYBE IR DALYVAVIMAS 
JVERTINIME 

Aptarus visus duomenis, pastebetas akivaizdus didziulis ne- 
atitikimas tarp institucijos ketinimq ir jvertinimo realybes. 
Isskirsiu du pagrindinius nesutapimus: tai kokybe ir daly- 
vavimas. 

Kokybes atveju, oficialiuose dokumentuose numatytas 
ir kiekybiniq, ir kokybiniq duomenq panaudojimas. Sis klau- 
simas keliamas taip, kad duomenq rinkimas ir jq interpre- 
tavimas laikomi dviem skirtingais jvertinimo proceso eta- 
pais. Taciau renkant duomenis is objektyviu duomenq ban- 
kq ir naudojant apklausos testus, prie kuriu parengimo la- 
biausiai prisidejo Rektoratas, akivaizdu, kad labiausiai bu- 
vo kreipiamas demesys j kiekybinius, o ne kokybinius duo- 
menis. Statistiniai duomenys, atrodo, yra vienintelis pripa- 
zintas patikimq duomenq saltinis. Is tikrqjq galejome nutar- 
ti isstudijuoti atskirq atvejj ar taikyti kitas kokybinio tyrimo 
priemones. Kai kurios kitos jvertinimo komisijos taip ir dare. 
Apie tai mqsteme ir, ko gero, turejome tai atlikti. Svarbiau- 
sia priezastis, del kurios nepasitelkeme kokybiniq tyrimo 
metodu yra ta, kad jie nebuvo aiskiai apibrezti universitetq 
tarybos pateiktame vadove. 

Kiekybiskumo akcentavimas daug aiskesnis 2001-2006 
metq jvertinimo plane. Naujajame vadove (Consejo de uni- 
versidades, 2001 ) pateiktas desimties puslapiq rodikliq prie- 
das, t. y. kiekybiniai rodikliai, kurie gaunami atlikus mate- 
matiniusskaiciavimus. Pavyzdziui, rodiklis RecHuml - zmo- 
giskieji istekiiai 1 - yra gaunamas padalijus pagrindinese 
pareigose dirbanciq destytoju skaiciu is viso destytojq skai- 
ciaus. Sis skaicius dauginamas is 100 ir reiskiamas pro- 
centais dviejq simtujq tikslumu. Tos pacios matematines 
proceduros atliekamos ir su kitais rodikliais, sugrupuotais j 
penkias skirtingas kategorijas 14 . Sie rodikliai yra privalomi, 
priesingai nei rodikliai pirmajame plane. Vadove akcentuo- 
jama interpretaciju svarba. Taciau aisku, kad pagrindiniai 
duomenys turi buti objektyvOs skaiciai. Tiesq sakant, kar- 
tais net neaisku, kq objektyvumas tiksliai reiskia. Siekdami 
tiksliq skaiciu, prarandame kai kuriuos duomenis, kuriuos 
skaiciais nejmanoma isreiksti. Taciau problema slypi ne skai- 
ciuose, paprastai prarandami esminiai dalykai ir siame, ir 


within subjects -data showed there was not much co- 
ordination. Some members of the internal committee 
thought that department disagreements could be ha- 
ving consequences for this issue. 

• To the university community: (1 ) To promote par- 
ticipation, both in institutional forums and evaluation 
processes. Most students did not take part in the polls, 
although of course they were represented. The faculty 
and staff members had too limited an involvement. (2) 
To democratise every university ambit. We do not talk 
about formal democracy, obviously existing, but fac- 
tual democracy, in which every community feels part 
of a wider one university depending on their involve- 
ment. 

The report finished by scheduling and prioritising 
those recommendations. 
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QUALITY AND PARTICIPATION 
IN EVALUATION 

After all the data discussed, I found a big disparity be- 
tween institutional intention and the reality of evalua- 
tion. I perceive mainly two differences: quality and par- 
ticipation. 

With regard to quality, official documents speak 
about using both quantitative and qualitative data. This 
point is so emphasized that data collecting and inter- 
pretation are considered as two different stages in the 
evaluation process. However, collecting data from 
banks of objective data and surveys mostly made by 
the Rector's office clearly supported use of quantita- 
tive data rather than qualitative data. Numerical data 
seemed to be the only recognized source of reliable 
data. It is true we could have decided to do a case 
study or to employ other qualitative tools. Some other 
evaluation committees did. We thought about that, and 
we should have done it. The point here is that those 
tools could be made explicit in the handbook provided 
by the Council of Universities, and they were not. 

This emphasis on quantitativeness is much clearer 
in the 2001 -2006 evaluation plan. In the new handbook 
(CONSEJO DE UNIVERSIDADES, 2001) there is a ten- 
page annex of indicators, that is, quantitative indexes 
to be obtained after mathematical calculation. For in- 
stance, the indicator RecHuml - Human resources 1 - 
is attained by dividing the number of full instructors by 
the total number of instructors. That number is multi- 
plied by 1 00, and shown as a percentage with two deci- 
mals. The same is done with other indicators grouped 
in five different categories 14 . These indicators are com- 
pulsory, in contrast with those of the first plan. Empha- 
sis on interpretation can still be found in the handbook. 
However, it is clear that objectivity of numbers is re- 
quired for the main data. Indeed the numbers are ob- 
jectives, although many times we do not know exactly 
what that objectivity accomplishes. We lose some data 
which are not possible to express by numbers. But the 
question is not the use of numbers, something worthy 
in this and many other evaluations. The point is the 
relegation of qualitative tools to a secondary and inci- 
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kituose jvertinimuose. Svarbu tai, kad kokybinems tyri- 
mo priemonems skiriama tik antraeile ar atsitiktine vieta. 
Jei norime objektyviai palyginti universitetus, - to siekia- 
ma Bolonijos deklaracijoje, - nera kito pasirinkimo. 

Kaip mineta, siq programq jvertinimo tikslas buvo pa- 
gerinti universitete teikiamij paslaugq kokybq. Taciau tin- 
kamesnis butu ne kokybes, o rezultatyvumo terminas. Ne- 
nuostabu, kad konkurencijatarp universitetqtampasvar- 
bia ji| egzistencijos sqlyga. Tai visiskai nauji standartai 
Ispanijos ir Europos universitetams. Is dalies tai siuolai- 
kinio jvertinimo, atliekamo JAV ir Britanijos universitetuo- 
se, kopija. Iskeltos temos tampa vis svarbesnes siuolai- 
kines socialines sistemos jvertinime. Ar programq jverti- 
nime reiketq siekti ne tiek kokybes, kiek rezultatyvumo? 
Ar jvertintojai turetq sias dvi sqvokas laikyti sinonimais? 
Ar konkurencingumas - tai budas sukurti galutinj ir pa- 
grjstq jvertinimo mechanizmq? Ar standartizuotas jverti- 
nimas, atliktas institucijoje, bus reikalingas tik pacios ins- 
titucijos savireklamai? 

Europiniu, nacionaliniu, regioniniu ir universitetiniu lyg- 
menimis stipriai akcentuojamas visuotinis dalyvavimas, 
nors ir nelabai sekmingai. Remdamasis patirtimi, galiu 
teigti, kad oficiali informacija yra teisinga. Vidinio ir isori- 
nio jvertinimo sistemos tik patvirtina sj tikslq. Problema 
ta, kad mazai zmoniq tuo tiki, arba nors ir tiki, bet taip 
nesielgia. Tai vienintelis paaiskinimas, kodel tiek mazai 
zmoniq dalyvavo muzikos mokytojo rengimo programos 
jvertinimo procese. 

Pirmoji problema, kilusi Granados universitete, buvo 
muzikos mokytojq rengimo komiteto paskyrimas. Oficia- 
liai as buvau paskirtas antruoju prezidentu, bet is tikrqjq 
buvau ketvirtas. Del jvairiq priezasciu trys mano kated- 
ros kolegos atsisake dalyvauti. Taip pat pasielge irfakul- 
teto akademinio personalo atstovai. Turejo dalyvauti ke- 
turi destytojai, bet vienas niekada nedalyvavo. Administ- 
racijos atstovas ateidavo j susirinkimus, bet pabaigoje 
isaiskejo, kad jj domino tik tai, kq mes galime pasakyti 
apie jo padalinj. Situacija del studentu nebuvo tokia dra- 
matiska, nors is keturiq jq atstovu liko trys jau is pat pra- 
dziq. Taciau ir pastarieji nereguliariai lankydavo susirin- 
kimus, atsizvelgdami j savo tvarkarascius ir iskilusias pro- 
blemas. Tq patj galima pasakyti ir apie kitus komisijos 
narius. As vienintelis buvau labiausiai jtrauktas j sj proce- 
ss galbut del to, kad neturejau kitos iseities. 

Stai taip lengviau arba sunkiau mes rinkome duome- 
nis ir siuntinejome anketas. Kai kurie studentai nenorejo 
pildyti anketu, argumentuodami, kad tai yra beprasmis- 
ka. Tai jie pasakydavo, kai auditorijoje nebudavo desty- 
tojo. Destytojai buvo linkq dar maziau bendradarbiauti. 
Jie paprasciausiai negrazindavo anketq. Tik septynios an- 
ketos buvo surinktos. Kiti universiteto darbuotojai dome- 
josi tik tais klausimais, pagal kuriuos buvo vertinama jq 
veikla. Trylika zmoniq dalyvavo atvirame susirinkime, kur 
buvo pristatoma pirmine ataskaita, trylika, jskaitant du 
zmones is padalinio, atsakingo uz jvertinimo proceso vyk- 
dymq universitete. Sesi studentai ir penki akademinio per- 
sonalo nariai dalyvavo susirinkime, kuriame diskutuota 
apie stipriqsias ir silpnqsias musq studijq programos pu- 
ses. Svarstant siuos klausimus, kiti universiteto darbuo- 
tojai nedalyvavo. 

Isorinio vertinimo metu situacija buvo dar jtemptes- 
ne. Kaip mineta anksciau, komitetas taip pat kviete j atvi- 


dental place. If we seek objective comparison among uni- 
versities, as is stated in the Bologna declaration, we have 
no choice. 

The stated purpose for these evaluation programs is 
to improve the quality of the universities. But efficiency 
rather than quality is the more appropriate term. Not sur- 
prisingly, competitiveness between universities is beco- 
ming an emergent condition. This is a completely new 
standard for Spanish and European universities. To a 
certain extent, it is a copy of the contemporary of evalua- 
tion of US and British universities. The topics raised are 
increasingly relevant in current social system evaluation. 
Should evaluation of programs be aimed at quality less 
than efficiency? Should evaluators consider these terms 
as synonymous? Is competitiveness a way to attain the 
final and legitimate mechanism of evaluation? Will stan- 
dardized evaluation implemented by one’s own institu- 
tion settle into mere self-promotion? 

With regard to full participation, it is strongly empha- 
sized by European, national, regional and university es- 
tablishments, but without much success. According to 
my experience, the official message is sincere. The inter- 
nal and external evaluation system corroborates this pur- 
pose. The problem is that not many people believe it, or 
even worst, they believe it but have not acted according- 
ly. This is the only explanation I have for the very low 
involvement in the evaluation process of participants in 
music teacher education programmes. 

At Granada, the first problem came with the appoint- 
ment of the music teacher education committee. Officially, 
I was the second president designated, but actually I was 
the fourth. For different reasons, three colleagues from 
my department declined. The same happened with fa- 
culty representatives. There should have been four in- 
structors, but one of them never came. There was a staff 
representative who attended meetings but in the end 
seemed only concerned above what we said about his 
sector. The situation was not so dramatic with students, 
albeit four representatives were reduced to three at the 
very beginning. The three participated irregularly, accor- 
ding to their schedules and the tasks before us. That was 
true of the other members of the committee as well. I was 
the one most involved in that evaluation, maybe because 
I felt I did not have a choice. 

With such lights and shadows, this is how we col- 
lected data and sent out questionnaires. Some students 
did not want to fill out the surveys, arguing it was use- 
less. They said that when no instructor was present. Fa- 
culty members were much less collaborative. They sim- 
ply did not send back their surveys. Only seven ques- 
tionnaires were picked up. The staff showed interest only 
when some issue related to them was dealt with. Thir- 
teen people attended the open meeting to present the 
early report, thirteen people, including two from the 
agency in charge of carrying out the evaluation process 
at the university. Six students, five faculty members, and 
no staff members attended the meeting at which we dis- 
cussed the strongest and weakest points in our academic 
programme. 

During the external phase, the situation was even more 
stressful. As I stated earlier, that committee also held open 
meetings with every sector involved in the foreign Ian- 
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rus susitikimus asmenis, dirbancius uzsienio kalbu ir mu- 
zikos mokytojo rengimo programose: destytojus, kitus 
darbuotojus, studentus ir absolventus. Dalyvauta buvo 
labai neaktyviai. j kai kuriuos is tq susitikimiq niekas neat- 
ejo. j susitikimq apie muzikos mokytojo rengimq atejo tik 
vienas zmogus. Ne viename susirinkime nedalyvavo dau- 
giau nei desimt zmoniq. 

Kai kq panasaus galima pasakyti ir apie dalyvavimq 
galutiniame muzikos mokytojo rengimo jvertinimo etape, 
kai rasoma ataskaita. Nupiesdamas tokj vaizdq, as ne- 
bandau kam nors skustis, tik noriu pavaizduoti aktyvaus 
dalyvavimo stokq, vykdant jvertinimq. 

Kodel dalyvauta taip pasyviai? Kiek man yra zinoma, 
tai jprastas reiskinys vertinant daugumq programq, - ne 
tik Granados universitete. Kodel zmones neateina pasa- 
kyti, kqjie galvoja, kai jiemssudarytagalimybe tai isreiksti, 
be to, tai ju profesine pareiga? Galutineje jvertinimo ata- 
skaitoje vidine komisija pazymejo keletq priezasciq: 

1. Komisija nesugebejo perteikti jvertinimo proceso 
svarbos. 

2. Destytojai, kiti darbuotojai ir studentai sumaise stu- 
dijq kokybes jvertinimq su atestavimu ar net su sankcijo- 
mis. Is tikrqjq, jvertinimas ir atestacija turi tq paciq reiks- 
mq ispanq kalboje (taip pat ir lietuviq k. - vertejo pasta- 
bet). Be to, zmones neturi formalaus jvertinimo patirties, 
taigi ziniu stoka ir netgi studentu ir destytojq/darbuotojq 
nepasitikejimas yra gana suprantami dalykai. 

3. jvairios akademines bendruomenes grupes nela- 
bai linkusios keistis. Zmones kritikuoja tarn tikrus daly- 
kus, bet is tikrqjq tik vienas kitas nori, kad status quo 
pasikeistq. 

4. jvertinimas skatinamas is virsaus. Studijq proceso 
dalyviai skeptiskai ziuri j kontroles grupes nariq ketini- 
mus. Komisijos, kuri atstovautu kiekvieno sektoriaus in- 
teresams atskirose programose, paskyrimas, nesukele 
didesnio pasitikejimo. 

5. Akivaizdu, kad universiteto kontroles taryba nejsi- 
vaizdavo, kokia dviprasmiska ju kalba. Viena vertus, jie 
kalbejo apie demokratijq ir visq dalyvavimo butinumq. Kita 
vertus, buvo kalbama apie jvertinimq, vartojant tokias s q- 
vokas kaip pazymiai, publikaeijos ir 1. 1. Taigi kalbeta apie 
tu paciu jvertinimo kriterijq, kurie yra taikomi privaciame 
versle, jgyvendinimq. jdomu pazymeti, kad svarstantga- 
luting ataskaitq Rektorate, tai buvo vienintelis diskusijq 
sukelps klausimas. Jokiu komentarq apie kitus proble- 
minius dalykus nebuvo pateikta. Be to, si konceptuali pro- 
blems atsispindejo ir ataskaitoje. 

Kiekviena is siu penkiq priezasciq turejo jtakos pasy- 
viam dalyvavimui jvertinime. Tuo paciu jos iskele kitus 
klausimus apmpstymams: ar jvertinimo programa, jgy- 
vendinta pacios institueijos jegomis, gali buti objektyvi? 
Kaip reiketq skatinti dalyvavimq jvertinimo procese, kai 
zmones visai nenori buti jvertinti? 

Galbut mano poziuris pesimistiskas. Galbut man de- 
rejo galvoti apie specifines problemas, pvz.: koks butq 
dalyviq procentas, jei butq vertinama kita programa? Ar 
turetume atmesti balsus tq, kurie dalyvavo? Ar musu ver- 
tinime dalyvavo studentai, fakulteto destytojai ir administ- 
raeijos darbuotojai, kurie nedalyvavo ankstesnese apklau- 
sose? Galbut cia atsakymai yra teigiami. 


guage and music education degrees: faculty members, 
staff, students, and alumni too. Participation was low. For 
some of those meetings nobody attended. At the music 
education sessions, at least one person attended. Never 
were there more than ten people. 

Something similar could be said about participation 
in the final stage of the music teacher education evalua- 
tion, writing the report. With this picture I do not try to 
complain of anybody, but to depict the lack of participa- 
tion with which this evaluation was carried out. 

Why was there such a low participation throughout? 
As far as I know, this was the general rule at most of the 
programmes evaluated, not only at the University of Gra- 
nada. Why did people not come to say what they think 
when they had the opportunity and professional obliga- 
tion? In the final evaluation report, the internal committee 
pointed out some possible reasons: 

1 . The committee did not manage to portray the value 
of the evaluation process. 

2. Faculty members, staff members, and students 
confused evaluation with assessment and even with sanc- 
tion. Actually, evaluation and assessment are the same 
word in Spanish. In addition, there is still little experience 
with formal evaluation, so lack of knowledge and even 
mistrust is understandable among staff members and 
students. 

3. Different groups are not really keen on change. 
People criticize particular things, but in fact few want the 
status quo changed. 

4. Evaluation is being promoted from the top. Partici- 
pants are sceptical about the intentions of trustees. Ap- 
pointment of a committee representing each sector in 
every programme did not evoke enough confidence. 

5. The board of trustees apparently did not realize 
the ambiguity of their language. On the one hand, they 
talked about democracy and the importance of full par- 
ticipation. On the other, they spoke about evaluation in 
terms of results with regard to grades, publications, and 
so on. They spoke about implementation of the same 
criteria of evaluation as private businesses. Curiously, this 
point in the final report was the only one questioned by 
the Office of the Rector agency. No comment on any other 
issue was forthcoming. In the end, this conceptual prob- 
lem was kept in the report. 

Each of these five possible reasons likely had a cer- 
tain influence on the scarce participation. At the same 
time, they led me to think of other topics becoming more 
relevant in current evaluation: Can an evaluation pro- 
gram implemented by one’s own institution be objec- 
tive? How should participation be promoted in an evalu- 
ation process when people do not really want to be 
evaluated? 

Perhaps my viewpoint was pessimistic at first. Per- 
haps I should have thought about more particular issues, 
like: how much would participation there have been had 
another process been carried out? Should we remove 
the voices of those who took part? Were there some stu- 
dents, staff and faculty members who did not take part in 
the past but did in our evaluation? Perhaps the answers 
here are positive. 
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Noreciau padekoti Robert Stake uz jo neikainojamus komen- 
tarus ir pasiulymus. 

Informacijq pateike Europos kokybes uztikrinimo tinklas ad- 
resu http://www.enqa.net. 

Visas citatas is ispanq kalbos i anglq kalbq isverte autorius. 
http://www.enqa.net/about.lasso 

Rekomendacijq 98/561 /EC 24 rugsejo 1998 galima rasti siuo 
adresu http://europa.eu.int/comm/education/socrates/eras- 
mus/recom.html. 

http://www.unige.ch/cre/activities/Bologna%20Forum/Bo- 

logna_welcome.htm 

Toks padalijimas j keturias grupes nuo tada dideja. Jis vis 
dar nera baigtas. 

Mano nuomone ne visi klausimai gali buti vertinami pagal 
tuos pacius kriterijus. Kai kurie klausimai yra labiau asme- 
niski ir neatspindi instituciniq problemu, todel neturetq buti 
jtraukti j institucijos studijq kokybes vertinimo vidurkj. 

Cia pateikti duomenys gauti pavasario semestro metu. Ru- 
dens semestro metu gauti duomenys panasus. 

0 Nuo 2001-2002 mokslo metq atliekamas zvalgomasis tyri- 
mas: taikoma sistema, kai studentai registruojasi internetu. 
Tai dabar jau tapo jprasta registracijos procedure, papildanti 
senqjqsistemq. 

1 Siuleme parengti naujus susitarimus su viesqjq mokyklq 
Kontroles taryba ir pakeisti treciojo kurso studentq prakti- 
kos atlikimo laikq, - praktikq nukelti is rudens j pavasario 
semestrq. Taigi Muzikos didaktika bus destoma pries Prak- 
tikumalll. Sis pakeitimas pirmq kartq buvo jgyvendintas siais 
mokslo metais. 

2 Atvirq susirinkimq metu vyko diskusija apie tai, koks turetq 
buti programos gerinimo tikslas: specializacija muzikoje ar 
globalus mokytojq rengimas? Argumentas uz specializacijq 
- sunkumai lavinant studentq muzikinj atlikimq. Argumentai 
uz labiau apibendrintq rengimq - dauguma muzikos moky- 
tojq turi dirbti bendrqjq dalykq mokytojais. 

3 Atvirq susirinkimu metu kai kurie destytojai pasake, kad 
sis pasiulymas per daug miglotas, palyginus su kitais ata- 
skaitos pasiulymais. Kiti teige, kad tai jau sis tas konkre- 
taus. Komisijos pozicija buvo eklektiska: turetume buti la- 
biau specifiski, bet negalime pasakyti - ir neturetume - 
kaip studentai turetq daryti tai, kas priklauso nuo jq ini- 
ciatyvos. Mes taip pat pazymejome ataskaitoje, kad tai 
jpareigojimas fakultetams - uztikrinti sqlygas siai atsako- 
mybei prisiimti. 

4 Daugiau informacijos galima rasti siuo adresu (Ispanq kal- 
ba) http://www.mec.es/consejou/indicadores/index.html. 


1 I would like to thank to Robert Stake all his invaluable com- 
ments and suggestions. 

2 Information provided by the European Network for Quality 
Assurance at http://www.enqa.net. 

3 All quotations formerly written in Spanish have been trans- 
lated by myself. 

4 http://www.enqa.net/about.lasso 

6 The Recommendation 98/561/EC of 24 September 1998 
can be found at http://europa.eu.int/comm/education/ 
socrates/erasmus/recom.html. 

6 http://www.unige.ch/cre/activities/Bologna%20Forum/ 
Bologna_welcome.htm 

7 This split into four groups has been increasingly imple- 
mented since then. It has not been completed yet. 

8 In my opinion not all items are following the same criteria. 
Some questions are personal more than institutional mat- 
ters and should not been included in any mean score of 
institutional quality. 

9 Data shown were obtained in the spring semester. Scores 
for the fall were similar. 

10 Since 2001/2002, there has been a pilot system in which 
education students can be registered through the internet. 
This is now a regular registration procedure in addition to 
the old system. 

11 We suggested finding a new arrangement with the public 
schools’ board of trustees, and the change practices for 
juniors from the fall semester to spring. Thus, Didactics of 
Music would be made before the Practicum III. This change 
has been carried out this school year for the first time. 

12 There was a discussion among those attending open meet- 
ings about what we should target for improvement: spe- 
cialization in music or global training as teachers? In fa- 
vour of specialization was the difficulty to train the music 
performance of students. On the side of generalization was 
the fact that many music teachers have to work as general 
teachers. 

13 During open meetings, some instructors said this proposal 
was too vague, in contrast with other report suggestions. 
Some others said it is something concrete indeed. The 
committee’s stance was eclectic: we should be more spe- 
cific, but we cannot - and should not - say how students 
must do something which depends on their own initiative. 
We also stated in the report that faculties should be com- 
mitted to letting that self-responsibility happen. 

14 Further information can be found - in Spanish - at http:// 
www.mec.es/consejou/indicadores/index.html. 
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1 priedas 


STUDENT^ NUOMONES TYRIMAS APIE DESTYMO KOKYBE; 
Granados Universitetas. jvertinimo ir kokybes tobulinimo tarnyba 


STUDENTg SKAICIUS 

FAKULTETO KODAS 

DALYKO KODAS 

ANKETOS NUMERIS 

(Studentams nepildyti) 



LYTIS: □ VYRAS 

MOTERIS 

GRANADA 

SEIMOS GYVENAMOJI VIETA: PRIEMIESTIS 

TOLIMESNI MIESTAI 


jvertinkite zemiau pateiktus teiginius nuo 1 iki 10 is dalykines puses 


1. JOsij Siam dalykui sugaistamas laikas per savaitg 


2. Jusg pasitenkinimas tuo, kg ismokote 


3. Paskaitg lankymo reguliarumas 


4. Individualioms konsultacijoms skirto iaiko isdestymas 


5. Akademiniai santykiai su kartu studijuojanciais 


6. Tolerancija ir pagarba auditorijoje 


7. Jusg studentg grupes atstovai 


8. Jusg domejimasis siuo dalyku 


9. Bendra Jusg nuomone apie jusg studijuojamg programg 


10. Bendradarbiavimas tarp studentg studijuojant sj dalyka 


11. Apie programs gaunama informacija: vertinimas, nuorodos j literature ir pan. 


12. Jusg nuomone apie studijg programos kokybg remiantis sio dalyko paskaitomis 


13. Sio dalyko svarba jusg profesiniame gyvenime 


14. Sio dalyko jtaka jusg asmeniniam studijavimui 


15. Perduodamo turinio naujoves 


16. Kreditg uz praktikos darbus jvykdymas 


17. Protines veiklos naudojimas (apmgstymai, samprotavimai irt.t.) 


18. Destytojo gebejimai sudominti dalyko turiniu 


19. Akademiniai santykiai su destytoju 


20. Ar jus pasitenkinti destytoju apskritai 


21 . Destytojo prieinamumas pageidaujant studentui 


22. Individuaiig konsultacijg jvykdymas 


23. Destymo nuoseklumas ir aiskumas 


24. Skirtingg veiklg ir metodg naudojimas 


25. Mokslines kritikos skatinimas 


26. Destytojo ir studentg dialogas, tiriant akademines dalyko problemas 


27. Destytojo vykdoma jusg studijavimo stebesena/ monitoringas 


28. Metodines medziagos tinkamumas (literatures sgraso, skaidrig, uzrasg klaseje irt.t.) 


29. Destytojo prisitaikymas prie studentg supratimo iygio 
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Annex 1 


STUDENTS’ OPINION SURVEY ABOUT TEACHING QUALITY 
University of Granada. Office for Evaluation and Quality Improvement 


STUDENTS NUMBER: 

FACULTY CODE: 

SUBJECT CODE: 

FORM NUMBER: 


(Not to be filled 

out by students) 



GENDER: 

MALE 

□ 

GRANADA 


r FAMILY RESIDENCE: 

□ 

SUBURBS 

r.'i 

FEMALE 





□ 

DISTANT TOWNS 


Rate from 1 to 10 the following aspects with regard to the subject deemed 


1 . Your weekly work for this subject 


2. Your satisfaction with what you have learned 


3. Your regularity attending classes 


4. Your deployment of tutoring time 


5. Academic relationships with your classmates 


6. Tolerance and respect in class 


7. Representatives of your students’ group 


8. Your interest for this subject 


9. At large, your opinion for your academic degree program 


1 0. Collaboration among students regarding their work for this subject 


11. Information received about the program: assessment, basic references, and the like 


1 2. Your opinion about the quality of the academic program followed for this subject 


13. Importance of this subject in your professional life 


14. Contribution of this subject to personal instruction 


15. Novelty of contents imparted 


16. Fulfilment of practice credits 


17. Use of mental processes (reflection, reasoning...) 


18. Instructor’s ability to promote interest for subject’s contents 


19. Academic relationship with your instructor 


20. At large, your satisfaction with your instructor 


21 . Instructor’s availability and accessibility towards students' requests 


22. Fulfilment of tutoring time 


23. Clarity and order in his/her expositions 


24. Use of different activities and methods procedures 


25. Promotion of scientific critique 


26. Instructor’s dialogue and students' enquiry into your academic problems for this subject 


27. Instructor's monitoring of your learning 


28. Material resources adjustment (bibliography, slides, class notes...) 


29. Instructor’s adaptation to student's level of comprehension 
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2 priedas 


STUDENTy NUOMONES TYRIMAS APIE PRAKTIKUMA III (SEMINARUS) 
Muzikos mokytoju rengimo programos vidine jvertinimo komisija 


LYTIS: □ VYRAS 

MOTERIS 

GRANADA 

SEIMOS GYVENAMOJI VIETA: PRIEMIESTIS 

TOLIMESNI MIESTAI 

VADOVAS: 

JOSE LUIS AROSTEGUI 
MARIA LUISA CALVO 
CARMEN MARTIN 
VICTOR NEUMAN 
MARIA ANGUSTIAS ORTIZ 


jvertinkite zemiau pateiktus teiginius nuo 1 iki 10 apie praktikos seminarus 

1. Jusy darbo intensyvumas (skaitymas ir jvairaus pobudzio rasymas) 


2. JQslj pasitenkinimas pradiniais, tarpiniais ir galutiniais seminarais 


3. Juslj pasitenkinimas seminarais, kuriuos vede jusy praktikos vadovas 


4. Individualioms konsultacijoms skirto laiko isdestymas 


5. Akademiniai santykiai su kartu studijuojanciais 


6. Jusy susidomejimas siais seminarais 


7. Bendras siy seminary jvertinimas 


8. Gauta informacija apie organizavimy: planavimy, seminarams skirty laiky, jvertinimy, literatury irt. t. 


9. Jusy poziuris j seminary turinio kokyby 


1 0. Sio dalyko svarba jusy profesiniam ir asmeniniam tobulejimui 


11. Jusy lukesciy ispildymas 


12. Reflektavimo ir samprotavimy naudojimas seminaruose 


13. Destytojo gebejimai jus sudominti seminaro metu 


14. Seminary sysajos su jusy patirtimi mokyklose 


15. Akademiniai santykiai su destytoju 


16. Bendras jusy pasitenkinimas destytoju 


17. Destytojo prieinamumas pageidaujant studentui 


18. Destymo nuoseklumas iraiskumas 


19. Destytojo ir kity studenty dialogas, aiskinantis jums mokykloje kiiusias problemas 


20. Destytojo prisitaikymas prie studenty supratimo lygio 


21. Pradiniy, tarpiniy irgalutiniy seminary nauda 


22. Bendras jusy pasitenkinimas praktikos vadovo darbu 
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Annex 2 


STUDENTS’ OPINION SURVEY ABOUT PRACTICUM III (SEMINARS) 
Internal Committee of the Music Teacher Education Programme 


GENDER: □ MALE 

FEMALE 

GRANADA 

FAMILY RESIDENCE: SUBURBS 

DISTANT TOWNS 

SUPERVISOR: 

JOSE LUIS AROSTEGUI 
MARIA LUISA CALVO 
CARMEN MARTIN 
VICTOR NEUMAN 
MARIA ANGUSTIAS ORTIZ 


Rate from 1 to 10 the following aspects with regard to the Practicum seminars 

1 . Intensity of your work (readings and papers) 


2. Your satisfaction with initial, middle, and final seminars 


3. Your satisfaction with seminars carried out with your supervisor instructor 


4. Your deployment of tutoring time 


5. Academic relationships with your classmates 


6. Your interest in these seminars 


7. Your overall rating of those seminars 


8. Information received about organization: planning, sessions, evaluation, bibliography... 


9. Your viewpoint about the quality of content dealt with. 


1 0. The importance of this subject in your professional and personal life 


1 1 . Accomplishment of your expectations 


12. Usage of reflection and reasoning in seminars 


13. Ability of instructor to promote your interest in seminars 


14. Relationship of seminars to your experience at schools 


15. Academic relationship with your instructor 


16. At large, your satisfaction with your instructors 


17. Availability and accessibility towards students’ requests 


18. Clarity and order in her/his exposition 


1 9. Instructor's dialogue and students’ enquiry into your problems at schools 


20. Instructor’s adaptation to student's level of comprehension 


21 . Usefulness of initial, middle, and final seminars 


22. On the whole, your satisfaction with the practicum coordinator’s labour 
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3 priedas 


STUDENTy NUOMONES TYRIMAS APIE UNIVERSITETO PASLAUGAS 
Granados Universitetas. jvertinimo ir kokybes tobulinimo tarnyba 


ANKETOS NUMERIS 

CENTRAS 

KURSAS 

(Studentams nepildyti) 


LYTIS: □ VYRAS 

MOTERIS 

GRANADA 

SEIMOS GYVENAMOJI VIETA: PRIEMIESTIS 

TOLIMESNI MIESTAI 

GYVENAMOJI VIETA: 

PRIVATI REZIDENCIJA 
UNIVERSITETO BENDRABUTIS 
SEIMOS 

NUOMOJAMAS BUTAS 
KITA 


jvertinkite zemiau pateiktas paslaugas nuo 1 iki 10 


1. Bendra jusp centra veikla 


2. Registracijos darbas 


3. Patalpp ir jrangos tinkamumas (auditorijos, laboratorijos irt.t.) 


4. Kulturine ir sportine veikla jusp centre 


5. Valymo ir prieziOros darbai 


6. Dekanato valdymas 


7. Kompiuterines laboratorijos 


8. Tolerancija ir pagarba jusg centre 


9. Kopijavimo paslaugos 


10. Kavine 


1 1 . Studentg atstovavimas jusg centre 


12. Budinciojo kambarelis 


13. Biblioteka jusg centre 


14. Administracines paslaugos 


15. Jusg nuomone apie studentg atstovavimg dirbant 


16. Studentg jsitraukimas j universiteto reikalus 


17. Maitinimosi vietg veikla 


18. Centrine biblioteka 


19. Vietos panaudojimas jusg centre 


20. Sportine veikla, organizuojama Universiteto Sporto Centro 


21 . Transporto iki jusg centra paslaugos 


22. Bankomatai ir vieso naudojimo telefonai jOsg centre 


23. Stipendijg tarnyba 


24. Universiteto jdarbinimo agentura 


25. Universiteto informacijos ir dokumentacijos paslaugos 


26. Nuolatinig studijg centras 


27. Universiteto atsakas j visuomenes poreikius 


28. Jusg dabartines gyvenamosios vietos kokybe, tuo atveju, jei skiriasi nuo jprastos 
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Annex 3 


STUDENTS’ OPINION SURVEY ABOUT UNIVERSITY SERVICES 
University of Granada. Office for Evaluation and Quality Improvement 


FORM NUMBER: 

CENTRE: 

COURSE: 

(Not to be filled out by students) 


GENDER: MALE 

FEMALE 

GRANADA 

FAMILY RESIDENCE: SUBURBS 

DISTANT TOWNS 


PRIVATE RESIDENCE 


HALL OF RESIDENCE 

LOCAL RESIDENCE: 

FAMILY 


LEASED FLAT 


OTHERS 


Rate from 1 to 10 the following services 


1 . Global operation of your centre 


2. Registration working 


3. Facilities adequacy (classrooms, laboratories...) 


4. Cultural and sporting activities at your centre 


5. Cleaning and maintenance services 


6. Dean’s Office management 


7. Computer labs 


8. Tolerance and respect ambiance at your centre 


9. Photocopy service 


10. Cafeteria 


1 1 . Students’ representation at your centre 


12. Porter’s lodge 


13. Library at your centre 


14. Administration services 


15. Your opinion about students’ representation working 


16. Student's involvement in university matters 


17. Dining halls operation 


18. Central library 


1 9. Distribution of spaces at your centre 


20. Sports activities organized by the University Sports Services 


21 . Transport services to your centre 


22. ATMs and public phones at your centre 


23. Grants Office 


24. University Employment Agency 


25. University Information and Documentation Service 


26. Permanent Training Centre 


27. The answer the University gives to society demands 


28. Quality of your current residence, in case it is different from familiar 





